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SSAVE_STACK = save stack ‘ 
SCREATE_CTX = allocate and in 
SDELETE_CTX = terminate threa 


eg 
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= Asynchronous wait for AST completion. 
K = create new execution thread 
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IDENT 'WO4=000" 


COPYRIGHT («) 1978, 1980, 1982, 1984 B 
Git PMENT CORPORATION, MAYNARD. MASSACHUSETTS. 


GHES A RESERVED. 


FTWARE i. rye uy SHED wees A LICENSE AND MAY BE USED AND COPIED 
TERMS OF SUCH CENSE AND WITH THE 

0 “Cory ot Bathe F THIS SOFTWARE OR ANY OTHER 

THEREOF A Y NOT BE P D OR OTHERWISE E AVA 

erzon- NO TITLE TO AND, OUNERSHIP OF THE SOFTWARE IS HEREBY 


soSze= ro 
Z2aO2Z2zt re 
ANNO —-—-\P 

_- 


THE INFORMATION IN THIS SOFTWARE IS SUBJECT TO CHANGE WITHOUT NOTICE 
onppokat the NOT BE CONSTRUED AS A COMMITMENT BY DIGITAL EQUIPMENT 


DIGITAL ASSUMES NO RESPONSIBILITY FOR THE USE OR RELIABILITY OF ITS 
SOFTWARE ON EQUIPMENT WHICH IS NOT SUPPLIED BY DIGITAL. 
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FACILITY: VAS Cluster Server Process 
ABSTRACT: Subroutines to initiate ‘wait'’ states for Cluster Servers 


and to create new threads of context. 


AUTHOR: Paul R. Beck 
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DATE: 3-MAR-1983 Last Edit: 22-JUN-1983 19:17:35 
REVISION HISTORY: 


v03-005 ADE0004 Alan D. Eldridge 24-Apr-1984 
Use CSPSS$CRASH rather than BUG_CHECK. 


v03-004 ApE000S Alan D. Eldrid 22-Mar-1984 


PUTTS BP BS BP BB WII III I I II nnononononononung 2 2 


NAME ANS OO NA VE WINI OOD NOAM EWN 9 OD NIA UNE WIN 9 O OD NONE OOOO Er — 


Bee Se Ge Se Ge Ge Ge Ge Ge Ge Ge Sse Ge Se Ge Ge Ge Ge Ge Ge Ge Ge Ge Ge Ge Ge Ge Ge Ge Ge Ge Ge Ge Se Ge Ge Ge Ge Ge Ge Ge Ge Ge Ge Se Ge Se Ge Se Ge Se Se 


Fix synchronization between CSPSSWAIT and CSPSSRESUME. 


v03-003 ADE0002 Alen D. Eldr idge 
Change name of CSPSSOPCOM o CSPSTELL_OPCOM 


v03-002 ADE0001 Alan D. h dridge 
ay e CSPSSAVE ,STACK ee 


t reall e stack. Move 


callable by 


28-F eb-1984 


3-Dec-1983 
‘8 i... Ste {ree CSP. gbse since ize is 


CPSCR AT this sang-CSPSbELEE~ orn Se s Pack that aT ba routines 
P 


nt threads are in one 


Sonsheaninest a between CSPSSRESUME and CS 


ues Changed 


v04~000 * "APHEBCISEE SLARS§ UME taesE HOE OO pag. 1 0G 


2 3 v03-001 precces aul Bec 6-JUN-1983 
: Change CTX$ seabott to Elks to prevent conflict with RCP. 


vo4~000 


0000140 


4 


SFDEF 
CLXDEF 


; Own storage 


CONTEXT_ID: 
CLX_SIZE: 


Include files 


: : 


«LONG 
- LONG 


SSEPTSBS BLiD9:08 ESYSLOR.SRESEsbuniNoman:s "88° <3, om 


1 
CLX$K_LENGTH 


3 storage for next CLX index 
3; CLX @ t on 
3 when ‘call by reference’ is needed 


ne stack frame offsets 


defi 
; define context block offsets 


ngth used as inpu parameter 


1 9 
CSPWA 16-SEP-1984 01:10: AX/VMS Macro v04-00 Pa 
§80~000 'CSPSSRESUME' BS EE1SBe BLi8:GS YSNCVOS Bacco yOsr00  , Page 4, 
 SBTTL "CSPSSRESUME' 
peneyes ven of AST tor saynehreneus calls. Reschedule the thread. This 
rows ree cen be specified directly as an AST, or it may be called from 


CALLING SEQUENCE: Standard AST (or get ted from and AST jacket routine). 
May also be called from ‘‘normal"’ leve 


FORMAL PARAMETERS: P1 = address of thread's context block 
COMPLETION CODES: N/A 


0000 eENTRY CSPSSRESUME, 0 i Save nothing 


§ This routine, since it is most often called via an AST, can 
; come before or may interrupt the execution of CSPSSWAIT. 


PPA QOD NAME WIN 9 OOD NAMEN SO OD NA UENO ODNOAUE UO ODN 
cece 


SO™*WMVOY F OM OFS DS Sb F FOUN WWW & & & & & } } 090900000000000000000000 0200 00CD 
RNP 3 9 HDD DD0D0000000000.0.0.0.002 0002 2 c9 00 C0090200-I 


50 04 AC 09 6 MOVL  4(AP),RO : Get context block 
07 08 AO O01 E : 1 BBCS @CLXSV_MUTEX,CLXSB_FLAGS(RO),10$ ; If BS, blocked by CSPSSWAIT 

1 1 : 

! ! : MUTEX was set. We cannot use the queve Linkage in the CLX 

1 1 : 

02 €2 0013 1 BBSS #CLX$V_RESUME_REQ,- : Tell CSPS$WAIT we interrupted 
22 0B A 15 1 CLXSB_FLAGS (RO) , 70S ; its execution 
1F 11 1 1 BRB 5 3; Done 

! ! 10$: ; 

! \ : MUTEX was clear. The queue Linkage in the CLX is ours to use. 
1A : 

03 0B 48 00 3 1 1 6Bcs #CLXSV_QUEVED,CLXSB_FLAGS(RO),30$ ; If BC, not yer queued 
5 ° F 1 1 REMQUE b ‘ ; Remove block from old queue 
4'FF 8 4 115 308: INSQUE (RO) ,@CSP$GQ_RESUME+4 3 «and reschedule the thread 
aot ft Ao 01 CE 1 BCC _ #CLX$V_MUTEX7CLX$B_FLAGS(RO),90$; Release interlock 
1 £ 3; Wake the CSP for processing 
04 } 50$: RET 3; Done 
00000004 ' 8F 0 ? } 70$: PUSH $358 NOPRIVSTRT +4 ; RESUME_REQ should have been 0 
0008'8F DD 004 1 208 PUSHL ass NOPRIVSTRT+8 : MUTEX should have been set 
EF 1 fe 4 1 0$: CALLS  #1,CSPSSCRASH 3; Report bug 
44 ! HALT ; Should never get here 
ie 


vee~000 CSPSS$WAIT = Asynchronous wait for AST co "erg Pa} 984 539508 SYSLOA. SAEIESPUAIS MAR; 1 ches (ay 


} »SBTTL CSPSSWAIT = Asynchronous wait for AST completion. 


The current stack is saved in an allocated block, which is saved in the 
current thread's context block. A test is then done to sge f the completion 
AST competed prior to this routine; if so one context is rescheduled. The 
routine then forces a scheduler run by collaps ng the stack and returning. 
CALLING SEQUENCE: CALL - never called from an AST routine. 

INPUT PARAMETERS: none 

OUTPUT PARAMETERS: N/A 


COMPLETION CODES: N/A 


NOs 


Sete Ge Ge Ge Ge Ge Ge Ge Ge T+ Se Se Se Ses 


OFFC sENTRY CSPSSWAIT,“M<R2,R3,R4,R5,R6,R7,RB,RI,RIO,R11> ; save all registers 


Save the current thread context. The context is now on the stack 
Lebron all registers except RO and R1. RO and R1 are saved 
separately since the calling standard enforced by the VAX 
architecture does not allow saving them in the entry mask. 


C82 Oe Oe Oe Ge Se eee 


G*CSPSSSAVE_STACK ; Save stack in current CLX 
MOVL G*CSPS$GL_CURCTX,R4 ; Get current CL 
G*CSPSGL_CURCTX 3; This thread no longer active 


v. SmReE 


0000000'GF 04 
We must test for a race condition with the completion AST. 


; Since this routine is never called from AST level, it may be 
3 interrupted by CSPSSRESUME -- but never vice versa. 


If BS, interlocked 


BBsS #CLXSV_MUTEX, CLX$B FLAGS (RG) . 908 : 
R4),50$ ; If BS, RESUME occured 


BBSS #CLX$V~QUEUVED, CLXSB~FLAGS ( 
INSQUE (R4),@CSPSGQ_WAIT+4 


7 ba Ac 00 ES 


before we interlocked 
00000004"FF 64 OE 


Queue it to wait List 


me ee a ek ed ed ed ed ed ed ed 8 — — — — - _ 


09090909 INI NN NENININNNNIOA AAA AAAS AA MUI EERE REE 
PIO OODNIA NE I 0 OO WA NEW 0 ODN UE WH" OWOOnVou 


50$: : 
3 Return to the scheduler. This is done by collapsing the stack to a 
3 known point, where there is a call frame used to enter the 
: scheduler. Then return with a success code. This will cause the 
3 scheduler to be reentered. 
1A 0B AG 01 CE BBCC =: ACLXSV_MUTEX, CLXSB_FLAGS(R4) ,90$ : Release interlock 
OA 0B AS O02 CE BBCC #CLX$VRESUME_REQ,CLXSB_FLAGS(R4).708_ ; if BS, RESUME occured 
3 since we interlocked 
54 $% OF ery (R4),R4 3; Remove CLX from WA 
90000008 0) 4 3 INSQUE (R4),@CSP$GQ_RESUME+4 3 gue t to RESUME List 
D 000000'GF 0D 70$:  MOVL  G*CSPSGL_BASE_FP,FP ; Po nt 0 schedu er 
3; sta 
50 00° oO MOVL S*#SS$_NORMAL ,RO 3 Declare success 


om 


4 
vee~000 CSPSSWAIT = Asynchronous wait ty co et et 94 2:49:08 Yeystoa. SReSe shun oMAR;1 rom (dy 
04 $3 1 RET 3 Go reschedule. 
90$: 


1 
4 QOOOOC'SF DD 1 PUSHL 4 he NOPRIVSTRT#12 3; Use phoney gtetus 
00 "EF 1 fe 1 hh ,CSPSSCRASH 3 report MUTEX conflict 
0 } HAL 3; Should never get here 

1 


88 
A -dsabl Lsb 


vO4~000 


00000000' 


00000062" 
52 


GF 


GF 
50 
1A 


0090008000  eF 
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» SBTTL CSPSSFORK = create new execution thread 


This is a fork routine. A new context block is allocated and initialized, 
and the current ° ntext is payed and wees 4 the thread resume (gran 
queue. LaF stack is NOT rec ned. and the scheduler is NOT ca atted” 
penoewer s eventual y entered sree thread thus queued is resumed at the 
return from this routine. The comp etion code used to qeteraine uhother 
the execution context is the new thread (SS *NORMALS or simply the creator 
of the thread (0). For example: 
CALLS 4% CSPSSFORK 
BLBC ; continue executing old thread 
BRW NEW_ THREAD 3; start executing new thread 


CAVEAT 


When creating a thread this way, be aware that the context saved 
is in the registers and stack. Local variables should be so defined. 


CALLING SEQUENCE: CALL 
FORMAL PARAMETERS: none 
COMPLETION CODES: 


SS$_NORMAL = The new thread has been resumed by the scheduler 
0 = The thread has been queued, context is intact 


CSPSSFORK ,“*M<R2,R3,R4,R5,R6,R7,R8,R9,R1I0,R11> ; save all registers 


PUSHL G*CSPSGL_CURCTX ; Temp save current context 


First, create the context block. 


SB G*CSPSSCREATE_CTX 3; Allocate new CLX block 
MOVL RO,R2 : Copy of new CLX pointer 
QL 10$ ; QL. allocation failure 


Now, save the current stack in the context block. This requires 
faking out CSPSSSAVE_STACK as to which is the current context. 


PS$GL_CURCTX 3; Store new context pointer 


OVL 
5B eeSoe SAVE~STACK : Save stack in new 


Next, schedule it. Force the seyed RO to SS$_NORMAL so that 
upon rescheduling the caller will sense that Ehis is the fork 
thread executing. 


Be Se Se Sete Sete CBee ee ee eceses 


CSPWAIT 16-SEP-1984 01:10:4 AX/VMS Macro V04- Page 
Goe~000 CSPSSFORK - create new execution thread $78 sats ri 8:08:88 SYSLOA.SRCJCSPWAIT.MAR; 1 . &) 
tt MOVL S*#SS$_NORMAL ,CLX$L_RO(R2) 3 ‘jam'’ success code 


28 A2 dO 
D 
FFSA CF 


50. D4 
00000000 ' GF sep? 


D. 
FB 


p aA sere ene ea gl 


|. 


; Setup paramete 


L 
CALLS if. CSPSSRESUME 3 «ee and reschedule the thread 


; Return with status=0 indicating that this isn't the fork thread yet. 
fLRL =e RO ; "'SS$_NOT_FORK"’ 
Bere G*CSPSGL_CURCTX ; Restore Current CLX pointer 


CSPWAIT 
v04-0 


007C 8F 
52 00000000'EF 
F 


— 
oon 


0000001C* 
00000000‘ EF 6 
3F 


8 
38 aan 9000000"6 GF 38 23 
3C A240 
OB A2 


-—-oP> 


1 
sd K = save stack frames pr “SEP- 
*CSPSSSAVE_STAC k f i : : 19 
"CSPSSSAVE_STACK = save stack frames prior to suspending thread’ 


OO NNN NNN INIOOOO 
AOOWONAOULS WN —O0Oe Wie 


CSPSSSAVE_STACK:: 
POSHR 


OOOOCOMwn—— —GDoOCcoVvVVTVCVCVCVCTVCVCVTCVTC0"0"0"00 


So 
PL HLNIM ON VOM MMMMMMMMMNo PWS DF LFOOCCCLOOMOWOO 


oO 


As SUME 


oO 
--@ 
w 


ss 
—Oom>-WPO 
ozce 
vo 


—wo-o- 


SOOoooooooooooooooooooooooooosoooooooooooooooo]o: 


tt  § MQOODOGDOOOOO OO OOOO 0000000000000 000000 


PASI 2 O ODNAUNE WIN 9 ODNAUE WN O OONAUE Wi 


FRR RAWWNNN 2 2 SS ao 


ereees OWDBZWOuvW 
ow 


~SEp= TSR BLi08:68 HeNSVOR Becta vot 00, Page 2, 


Allocate memory to save the current stack (from top to the scheduler call 
» and store it in the current thread's context block. 


CALLING SEQUENCE: JSB 
FORMAL PARAMETERS: none 
IMPLIED INPUTS: CSPSGL_CURCTX = address of genseut block in which to store 


the saved stac 


COMPLETION CODES: SS$_NORMAL, or failure code from LIBSSGET_VM 


-PSECT SPLITS,NOWRT,NOEXE,2 


ASCII = ‘CSPSSSAVE_STACK: CURCTX=0'<0><0><0> : 
eLONG 17694745 : 
-ADDRESS P.AAK 3 
ePSECT S$CODES,NOWRT,2 

#°M<R2, R3,R4,R5,R6> ; Save regs 

CSPSGL_CURCTX,R2 ; Get current CLX block 
NEQ ig 3; If NEQ, it's there 
PUSHAB 3 HP message desc. 
CALLS Win *eSPSTELL_OPCOM 3 ay message 
LRL RO’ 3 Indica e error 

40$ 3; Take common exit 


We save the ptock from CSP$GL_BASE ff + i te, end ing Luding the 
current stack frame (note JSB interface is assumes that this 
routine $ always called from a WAIT or a FORK routine which has 
been CALL Fed by the thread which needs the context block saved. 


CLX$L_R1 Fa 4+CLXS$L_RO 
cR CLRSL ROC : Save RO,R1 
‘ #CLXSM LOCAL, STAck cLXxsB FLAGS (R2) : Init flag 
Ag E FP,CLX rt STACKSIZE(R2) : Determ ne stack size 
chi L STACKSITEC RO). MCLXSR_LOCAL_STACK ; TY°CInOY Ye ? 
CLX$B AOC STACK(R2),CLXSA_STACK(R2) : Setup st Bi ptr 
#CLXSA_LOCAC_STACK, CLX$B_ FLAGS (R2) 3 Indicate eUx stack 
- Lontinue 


Must allocate a block to hold the stack 


voe=000 


44 


00000000 ' GF p iS 
3¢ B2 6D A 5 


22 
i 
4 
A 
Bel 
3 


81 


"CSPSSSAVE_STACK = save stack frames pri "r8 pa} 984 84:09:69 


AX/VMS Bacce YOR 00 
SYSLOA.SRCJCSPWAI 


«MAR; 1 


Point to block ptr 
Point to block size 
Allocate the block 
If LBC, failed 

Copy stack 


Setup success status 
Restore regs 


C 10 


CSPWAIT 16-SEP-1984 01:10:4 AX/VMS Macro V04-00 Page 1 
yo4~000 *CSPSSCREATE_CTX = allocate and initiali §- FE 88 81:38:98 SYSLOA.SRCIJCSPWAIT.MAR; 1 ° 4, 
git -SBTTL ‘CSPSSCREATE_CTX = allocate and initialize context block’ 

. Allocate and initialize a context block. 

5 CALLING SEQUENCE:  JSB 

$ INPUT PARAMETERS: RO Scratch 

; OUTPUT PARAMETERS: RO Address of context block is returned 

: (0 if error). 

isp 


decane > Vai 


3F #°M<RO,R1,R2,R3,R4,R5> Save regs 


Address of block pointer 


nn 
or 
Fo 


oF 9 PUSHAB (SP) 
0000004" oF 


=O OONOAUN EWN O ODNOA UNE UP  OOONOUNE 
o 
> 
a 
i 
nm 


4 
4 
4 
4 
4 
4 | 
2 3 
8 6 4 PUSHAB gh SIZE ; Address of block length 
00000000 ' GF 2 FB ; 4 #2,G*LIBSGET_VM 3; Allocate the block 
1c 38 5° 7 BLBC 10$ : If LBC then failed 
00 BE 0140 8F 00 0 76 MOVCS } * (SP) ,#O,MCLXSK_ LENGTH,@(SP) ; Zer t 
6— OD 7F MOVL  (SP),RO ; Pickup the block 
24 AO O0000000'EF 0D O82 5 MOVL CONTENT _1D, CLXSL_INDEX(RO) : Enter the i.d. 
0000000 ++ 06 3 A ; INCL sont EXT_ID ; Bump the i.d. for next time 
2 11 38 BRB 0$ ; Take common exit 
D4 bat : 10$ CLRL (SP) 3; Say ‘'no block allocated’ 
3F BA 094 59 20$ POPR #*M<RO,R1,R2,R3,R4,R5> ; Restore regs 
5 BoeF ? RSB 3; Done 


dD 10 
CSPWAIT 16-SEP-1984 01:10:4 AX/VMS Macro V04-00 Pa 1 
vou-000 "CSPSSDELETE_CTX = terminate thread’ at ioe TS 4:09:08 SYSLOA.SRCIJCSPWAIT.MAR; 1 - () 


4 oo -SBTTL ‘CSPSSDELETE_CTX = terminate thread’ 
§ : Terminate an execution thread by deleting the context block and 
2 ; clearing the pointer. 
; ; CALLING SEQUENCE: JSB 
? : FORMAL PARAMETERS: None 
zt i : COMPLETION CODES: N/A 
97 376 ESPSSDELETE CTX: 
00000000'GF 9F 44 4 PUSRAB G*CSPSGL_CURCTX ; Create pointer to CLX pointer 
00 8 03 9 8 TSTL a(SP) : Test current CLX block ptr 
1 A 0 BNEQ : If NEQ, there was one 
00000000 ' EF 0 + A CALLS #0, MUMBLE ; Report bug 
FY ay BRB 20$ ; Take common exit 
6E bo AB 4 10$:  PUSHL (SP) : Setup ptr to block ptr 
99000006 ' Ft F ae 5 PUSHAB 5h SIZE 3 getup ptr to length 
00000000 ' GF 2 FB ; § CALLS @#@ -G*LIBSFREE_VM ; Deallocate the block 
9E Be A 8 20$ CLRL a(SP)+ : Zero CSP$GL_CURCTX, fix stack 
5 pat 3 RSB 3; Return 


E 10 
vee~000 *CSPSSDELETE_CTX = terminate thread’ "Ec Sp=|98¢ te 48; 38 SYSLOA. Sf sae tie CSPw NOATS OMAR: 31 awe day Von 


SBD 338 -end 


C Tt & "9-3 S ath 9 4 +19: 48 A at 0 V04-00 Page } 
table 4 04:09:0 SYSLOA. sre SCSPWAIT. MAR; 1 ( 


CLXSA_STACK = C 
CLXSB-FLAGS = 
ELaSS LOCAL STACK = 
CLXSK_LENGTA = 4 
EL SK .LOCAL STACK = 
ECASE ORO a 8 
= 
ECASECR = 
CLXSL_STACKSIZE = 
CLXSM_LOCAL_STACK z= 
CLXSV_MUTEX™ = 
CLXSV_QUEUED = 
CLXSV eee = 
CLX st R 1 
CONTER ID OR 1 
CSPSSCRASH eeereene 1 
CSPSSCREATE_CTX $ RG 4 
CSPSSDELETE_CTX RG 4 
CSPSSFORK AS RG 1 
CSPSSRES RG 1 
CSPSSSAVE_STACK RG 4 
CSPSS$WAI RG 1 
CSP$GL_BASE_FP eeereeee =X 1 
CSPSGL_CURCTX eeeeneee Xx 1 
CSP$GQ_RESUME eeneeeee 8X 1 
CSP$GQ_ WAIT aeeeenee 1 
CSPSTECL_OPCOM eeeeeeee 4 
LIBSFREE VA aeeeeene 86 4 
LIBSGET_0m eeeneeee 8 4 
MUMBLE 5000001C x 4 
P.AAJ iC R 
PAAR 80000005 RO 
SS$_NOPRIVSTRT eererene § 1 
SS$_ NORMA Reeeeeee x 1 
SYSSWAKE eeekereer GX 1 
per esr een caceec anaes + 
; Psect synopsis ! 

PSECT name Allocation PSECT No. Attributes 
« 46 « ( -)» 00 ¢ -) NOPIC  USR ABS LCL NOS HA NOEXE NORD NOWRT NOVEC BYTE 

BLANK . ( 216.) QO1 ¢ -) NOPIC USR CON REL LCL NOSH EXE D WRT NOVEC BYTE 
$aBS$ ( ) § ( -) NOPIC USR CON ABS _ LCL NOSH EXE R WRT NOVEC BYTE 
SPLITS ( ; on ( -) NOPIC USR CON REL LCL NOSHR NOEXE RD NOWRT NOVEC LONG 
SCODES D ¢ 189.) 04 ¢ 4.) NOPIC  USR REL LCL NOSHR EXE RD NOWRT NOVEC LONG 

Gneeeeneenennnesoensonenet 
! ; Performance indicators ! 

Phase Page faults CPU Time Elapsed Time 


Feet reveetn ORES BER 


G 10 

CSPWAIT 16-SEP-1984 AX/VMS Ma 04 
vane Macro Run Statistics g-SEF =}382 8}: 48: $8 YOYSLOA. SRE ICSPUAT MAR; 1 
pass. ¢ table sort :00:00.07 

Symbol table output 00:00. 
Psect synopsis output :00:00. 
Cross-reference output :00:00. 
Assembler run totals 39 00:02. 


10808 bytes est Limit wa ub pages. 


oyeee, (20 pages) o rtual memory were wee i buffer the intermediate aor 
ynere were pages of symb L table snare. al ae hold 95 non-local and 18 local symbols. 
3 source t nes were read in Pass 1, produ J: ect records in Pass 2. 
pages of virtual memory were used to def ne 9, macros. 


a i i eo 


Macro library name Macros defined 
5 SDUA2 :CSYSLOA. SP 2CLUS TER. -MLB;1 1 
“$255$0UA28: (SYS .08 1 9 
“$255$DUA08: (SYSLIB STARLET. Pale: :2 

TOTALS (all libraries) 8 


155 GETS were required to define 8 macros. 
There were no errors, warnings or information messages. 
MACRO/LIS=L1S$:CSPWAIT/OBJ=OBJ$:CSPWAIT MSRC$:CSPWAIT/UPDATE=(ENHS: CSPWAIT) +EXECMLS/LIB+LIB$:CLUSTER/LIB 


row df 


vos 
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